® 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




0 Publication number: 



0 436 345 A2 



EUROPEAN PATENT APPLICATION 



© Application number: 90313817.0 
@ Date of filing: 18.12.90 



© int. Ci. 5 : H04M 1/57, H04Q 11/04 



The title of the invention has been amended 
(Guidelines for Examination in the EPO, A-lll, 

7.3). 

© Priority: 20.12.89 JP 332424/89 
21.09.90 JP 253415/90 

© Date of publication of application: 
10.07.91 Bulletin 91/28 

® Designated Contracting States: 
OE FR GB 

© Applicant: CANON KABUSHIKI KAISHA 
30-2, 3-chome, Shimomaruko, Ohta-ku 
Tokyo(JP) 



© Inventor: Sato, Ryoichiro, c/o Canon 
Kabushiki Kaisha 

30-2, 3-chome, Shimomaruko, Ohta-ku 
Tokyo(JP) 

Inventor: Kadowakl, Shuichl, c/o Canon 
Kabushiki Kaisha 

30-2, 3-chome, Shimomaruko, Ohta-ku 
Tokyo(JP) 

© Representative: Beresford, Keith Denis Lewis 
et al 

BERESFORD & Co. 2-5 Warwick Court High 
Holborn 

London WC1R 5DJ(GB) 



© Voice and image communicating apparatus. 



CM 
< 

in 
<* 

CO 

CO 
CO 



Q. 
Ul 



© There is disclosed a communicating apparatus 
such as a television telephone connected to the 
ISDN having a calling party number display service, 
comprising: a receiving unit for receiving image data 
sent from a calling party communicating apparatus; 
a memory for storing the image data received by the 
receiving unit in correspondence to ID data indica- 
tive of the calling party communicating apparatus; 
and a display apparatus for receiving the ID data 




upon call reception from the calling party commu- 
nicating apparatus and for reading out the image 
data corresponding to the received ID data from the 
memory and for displaying. Before a speech is start- 
ed, the user can see the image information regard- 
ing the calling party and can immediately disconnect 
the communication if he doesn't want to make a 
speech to the calling party upon call reception there- 
from. 



FIG. 1 







9 

\ 




10 

>' 


1 ' 




IS0N INTERFACE 




ISDN 


/ 


















CONTROL UNIT 








—7 








AU010 cooec 




\ 












MEMORY 






IMAGE COOEC 








8 







Xerox Copy Centre 



1 



EP 0 436 345 A2 



2 



COMMUNICATING APPARATUS 



BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a communicat- 
ing apparatus which is connected to a network 
such as an ISDN or the like and executes a com- 
munication of a voice, an image, or the like and, 
more particularly, to a communicating apparatus for 
displaying a special image upon call reception. 

Related Background Art 

Hitherto, a television telephone set has been 
known as a multimedia communicating apparatus 
which can communicate a voice and an image. 

Hitherto, in the television telephone set con- 
nected to the ISDN, when a call reception 
(reception calling) was performed, an ID number on 
the calling side (calling party telephone number) is 
informed to the reception side (CCITT Recommen- 
dation, calling number display of I. 251 C). There- 
fore, the number is displayed on an image display 
apparatus and the telephone number of the calling 
party can be known. 

However, in the above conventional technique, 
although the calling party telephone number itself 
can be known before the reception side responds 
to a call reception, in order to presume the calling 
partner from the telephone number, the user ac- 
tually must learn a number of calling party tele- 
phone numbers by heart. Such a notification of the 
calling party telephone number is not so effective 
in the case of presuming the calling party before 
making a response in spite of the notification of the 
calling party telephone number. 

As a method of solving such a drawback, it is 
also possible to use a method of knowing the name 
of the calling party by using a user 'user signal 
(UUS) of the ISDN. As a method whereby informa- 
tion such as a calling party name or the like is 
informed from the originating call terminal, there 
has been known a method disclosed in U.S. Patent 
Application Serial No. 307,506 filed on February 8. 
1989. 

However, the above method has a problem 
such that a condition such that the calling party 
sends name information is used as a prerequisite 
and that a special adding apparatus is needed. 

On the other hand, there has been proposed a 
method whereby a correspondence relation be- 
tween the telephone number on the originating call 
side and the calling party name has previously 
been input on the called side and the calling party 
name corresponding to the telephone number 



which coincides with the calling party number 
which was informed is displayed on an image 
display apparatus of a television telephone set 
(U.S. Patent Application Serial No. 363,860 filed on 

5 June 9, 1989). 

However, there are problems such that in order 
to realize the above method, inputting means such 
as a television camera or the like needs to be 
newly provided and that it is necessary to pre- 

w viously execute complicated inputting operations. 

SUMMARY OF THE INVENTION 

It is an object of the invention to solve the 
;5 drawbacks of the conventional techniques as men- 
tioned above and to provide a communicating ap- 
paratus which can register an image regarding a 
calling party communicating apparatus which is 
displayed upon call reception by a simple method. 
20 Another object of the invention is to provide a 
communicating apparatus which can register an 
image regarding a calling party communicating ap- 
paratus by a simple construction without providing 
any special inputting apparatus. 
25 To accomplish the above object, according to 

the invention, there is provided a communicating 
apparatus comprising: receiving means for receiv- 
ing image data which was sent from a calling party 
communicating apparatus; memory means for stor- 
30 ing the image data received by the receiving 
means in correspondence to ID data indicative of 
the calling party communicating apparatus; and 
display means for receiving the ID data upon call 
reception from the calling party communicating ap- 
35 paratus and for reading out the image data cor- 
responding to the received ID data from the mem- 
ory means and displaying. 

Another object of the invention is to provide a 
communicating apparatus with a simple construc- 
40 tion in which just before a reception side responds 
to a reception call, image information regarding a 
calling party which will be effective if it is displayed 
on an image display apparatus on the reception 
side can previously been stored on the reception 
45 ' side by a simple operation. 

Still another object of the invention is to im- 
: prove information regarding a calling party commu- 
nicating apparatus which is displayed upon recep- 
tion. 

so That is, according to the invention, a plurality of 

sheets of information regarding the calling party 
communicating apparatus are displayed simulta- 
neously or as a moving image upon reception. 

Thus, a recognition degree of the calling party 
communicating apparatus to the operator can be 
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improved. 

Further another object of the invention is to 
provide a communicating apparatus which can rec- 
ognize a plurality of persons which use the appara- 
tus of the same calling party number. 

Further another object of the invention is to 
provide a communicating apparatus which can see 
the face of a person as a communication party 
upon reception. 

Further another object of the invention is to 
provide a communicating apparatus in which in- 
formation regarding a communication party is dis- 
played upon reception and when the user doesn't 
want to communicate by checking the displayed 
information, a communication can be disconnected 
before data is received. 

The above and other objects and features of 
the present invention will become apparent from 
the following detailed description and the appended 
claims with reference to the accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

f\g. 1 is a whole arrangement diagram of a 
television telephone set which is connected to 
the ISDN according to the first embodiment of 
the invention; 

Fig. 2 is an external view of the television tele- 
phone set connected to the ISDN shown in Fig. 
1; 

Fig. 3 is a constructional diagram of a memory 2 
shown in Fig. 1 ; 

Figs. 4 and 6 are program flowcharts showing 
fetching (storing) control procedure of image 
information which are executed in a control unit 
1 shown in Fig. 1; 

Fig. 5 is a program flowchart showing a display 
control procedure of image information which is 
executed in the control unit 1 shown in Fig. 1; 
Fig. 7 is an external view of another embodi- 
ment of the television telephone set connected 
to the ISDN shown in Fig. 2; 
Fig. 8 is a program flowchart showing a fetching 
(storing) control procedure of image information 
which is executed in the control unit of the 
television telephone set shown in Fig. 7; 
Fig. 9 is a block arrangement diagram of a 
multimedia communicating apparatus according 
to the second embodiment of the invention; 
Fig. 10 is a front view of a display unit of the 
apparatus shown in Fig. 9; 
Fig. 11 is a flowchart showing a control proce- 
dure of the apparatus; and 
Figs. 12, 13, and 14 are flowcharts in the case 
of modifying a part of the flowchart of Fig. 1 1 . 

DETAILED DESCRIPTION OF THE PREFERRED 

EMBODIMENTS 



Embodiments of the invention will be described 
in detail hereinbelow with reference to the draw- 
ings. 



Fig. 1 is a whole arrangement diagram of a 
television telephone set which is connected to the 
ISDN according to the first embodiment of the 
w invention. In the diagram, reference numeral 1 de- 
notes a control unit comprising a CPU for control- 
ling the operation of the ISDN connected television 
telephone set, a ROM, and a RAM. A memory 2 is 
connected to the control unit 1 . The following var- 
75 ious apparatuses are connected to the control unit 
1 through an I/O port (not shown). That is, to the 
I/O port, there are connected: an operation key 3 
for designating and inputting a calling party tele- 
phone number or the like upon calling or the like 
20 from this side of the television telephone; an image 
display unit 4 comprising a CRT display for dis- 
playing image information which is sent from the 
calling party and the telephone number or the like 
of the calling party; a handset 5 as a transceiver for 
25 transferring a voice; a camera unit 6 for inputting 
an image on this side; an audio codec 7 for execut- 
ing the A/D and D/A conversions between a digital 
signal which is processed by the ISDN and an 
audio analog signal which is input/output to/from 
30 the handset 5; an image codec 8 for executing the 
D/A conversion from the digital signal of the ISDN 
into the image analog signal of the display unit 4 
and the A/D conversion from the image analog 
signal of the camera unit 6 into the digital signal of 
35 the ISDN; and an ISDN interface 9 for connecting 
an ISDN (integrated services digital network) 10 
and the television telephone, respectively. Further, 
an image fetch key 1 1 comprising a push switch is 
connected to the I/O port. The image fetch key 1 1 
40 generates a command signal to store a calling side 
image such as a face of the person on the calling 
party side or the like into the memory 2 by a 
pushing operation. 

Fig. 2 shows an external view of the television 
45 telephone set connected to the ISDN constructed 
as mentioned above. 

Fig. 3 shows a part of a construction in the 
memory 2. The memory 2 is constructed by a 
volatile memory device comprising four areas 201 
.so to 204. Reference numeral 201 denotes the calling 
party number area in call reception for storing the 
calling party telephone number (destination side 
telephone number) which is sent from the ISDN 
upon call reception (calling on the reception side) 
55 and 202 indicates the calling party number area in 
line connection for storing the calling party number 
when the line is connected, that is. while a speech 
is being executed. Upon reception by calling from 



5 (First embodiment) 
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the calling party, the calling party number which is 
sent from the ISDN is stored into the area 202. 
Upon calling from this side, the calling party num- 
ber which was input by using the operation key 3 is 
stored into the area 202. Reference numeral 203 
represents n telephone number areas of Nos. 1 to 
n each for storing the telephone number. Refer- 
ence numeral 204 indicates n image areas of Nos. 
1 to n each for storing image information in cor- 
respondence to the areas in the area 203. 

A procedure for a fetching (storing) control of 
image information which is executed by the control 
unit 1 will now be described in detail in accordance 
with a program flowchart shown in Fig. 4. This 
program is executed when the image fetch key 1 1 
was pushed (depressed) when the line is con- 
nected, that is, while an image from the calling 
party is being received. 

In the first step S401 , the calling party number 
stored in the calling party number area 202 in line 
connection, that is, the calling party number which 
is sent from the ISDN in the case of the call 
reception by calling from the calling party side or 
the calling party number which was input by the 
operation key 3 in the case of the calling from this 
side is read out. The calling party number in line 
connection is stored into the area 202 upon recep- 
tion or key inputting operation. 

A pointer to designate an object to be com- 
pared is set into the top telephone number area of 
No. 1 in the area 203 (step S402). A check is made 
to see if the number information stored in the 
telephone number area of No. 1 coincides with the 
calling party number which was read out in step 
S401 or not (step S403). If NO in step S403, the 
pointer is sequentially moved to the next telephone 
number area (the telephone number area of No. 2 
in this case) (step S404). In step S405, a check is 
made to see if the comparison between the calling 
party number which had been read out in step 
S401 and ail of the telephone numbers stored in 
the whole areas in which the telephone numbers 
had been stored in the telephone number area 203 
has been completed or not. That is, a check is 
made to see if the pointer has been moved to all of 
the telephone number areas in which the telephone 
numbers had been stored and the point has arrived 
at the telephone number area in which no tele- 
phone number is stored or if there is no area to 
which the pointer moves (the pointer has already 
reached the last telephone number area of No. n) 
or not as a result of the movement of the pointer. If 
NO in step S405, that is, if the comparison be- 
tween the calling party number (i.e., destination 
side number) which was read out in step S401 and 
all of the telephone numbers in the whole areas in 
which the telephone numbers have been stored in 
the telephone number area 203 is not completed 



yet, the processing routine is returned to step 
S403. The processes in steps S403 to S405 are 
repeated. 

When the calling party number which was read 
5 out in step S401 coincides with the telephone num- 
ber stored in any one of the areas of Nos. 1 to n in 
the telephone number area 203 (if YES in step 
S403), the image which had been received from 
the calling party through the ISDN and was dis- 
io played in the image display unit 4 is stored (step 
$406) into the image area corresponding to the 
telephone number area in which the coincident 
telephone number has been stored. The present 
program is finished. The execution of step S406 
;5 intends to change the image which has already 
been stored. 

If YES in step S405, that is, if the number 
corresponding to the calling party number which 
was read out in step S401 cannot be found out 
20 from all of the areas in the telephone number area 
203, a check is made to see if a vacant area in 
which no telephone number is stored exists in the 
telephone number area 203 or not (step S407). If 
YES in step S407, the calling party number which 
25 was read out in step S401 is stored into the top 
area in the vacant area and the image information 
which was received from the calling party and 
displayed in the image display unit 4 is stored into 
the image area corresponding to the relevant area 
30 into which the calling party number was stored 
(step S408). The present program is finished. On 
the other hand, if NO in step S407, the storage 
contents of a predetermined set of areas in the 
telephone number area 203 are erased and the 
35 calling party number which was read out in step 
S401 and the image information displayed in the 
display unit 4 are respectively stored (updated) 
(step S409). The predetermined set of areas can 
be also changed in accordance with the order of 
40 the area numbers (1, 2, .... n) every completion of 
the storing and updating processes. 

As mentioned above, by merely pushing the 
image fetch key 11 in the line connection, the 
image of the face of the person on the calling party 
45 side upon speech communication can be easily 
stored in correspondence to the calling party tele- 
phone number irrespective of the reception and 
. transmission. That is, the calling party telephone 
number and the image information which is pecu- 
50 liar to the calling party are stored in correspon- 
dence to each set of the telephone number area 
203 and the image area 204 corresponding thereto. 

A procedure of the display control of image 
information which is executed by the control sec- 
55 tion 1 and is used to access the image information 
stored as mentioned above upon reception call and 
to display by the image display unit 4 will now be 
described in detail in accordance with a program 
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flowchart shown in Ftg. 5. This program is ex- 
ecuted every reception call (calling on the recep- 
tion side). 

In the first step S501, the calling party number 
(i.e.. destination number) stored in the calling party 
number area 201 in call reception, that is, the 
calling party number which is sent from the ISDN 
is read out. The calling party number is stored in 
the area 201. 

Then, the pointer to designate an object to be 
compared is set into the top telephone number 
area of No. 1 in the telephone number area 203 
(step S502). A check is made to see if the calling 
party number stored in the telephone number area 
of No. 1 coincides with the calling party number 
which was read out in step S501 or not (step 
S503). If NO in step S503, the pointer is sequen- 
tially moved to the next telephone number area 
(the telephone number area of No. 2 in this case) 
(step S504). In step S505, a check is made to see 
if the comparison between the calling party number 
which had been read out in step S501 and all of 
the telephone numbers in the whole areas in which 
the telephone numbers had been stored in the 
telephone number area 203 has been completed or 
not. That is. a check is made to see if the pointer 
has been moved to all of the telephone number 
areas in which the telephone numbers had been 
stored and the pointer has reached the telephone 
number area in which no telephone number is 
stored or there is no area to which the pointer 
moves (the pointer has already reached the last 
telephone number area of No. n) or not as a result 
of the movement of the pointer in step S504. If NO 
in step S505, that is, if the comparison between the 
calling party number which was read out in step 
S501 and all of the telephone numbers in the whole 
areas in which the telephone numbers have been 
stored in the telephone number area 203 is not 
completed yet. the processing routine is returned 
to step S503 and the processes in steps S503 to 
S505 are repeated. 

rf the calling party number which was read out 
in step S501 coincides with the telephone number 
stored in any one of the areas in the telephone 
number area 203 (namely, if YES in step S503). 
the image information stored in the image area 
corresponding to the telephone number area in 
which the coincident telephone number has been 
stored is displayed in the display unit 4 (step S506) 
and the processing routine advances to step S507, 
which will be explained hereinlater. 

If YES in step S505, that is, if the number 
corresponding to the calling party number which 
was read out in step S501 cannot be found out 
from all of the areas in the telephone number area 
203, only the calling party number which was in- 
formed from the ISDN is displayed in the display 



unit 4 (step S507). A reception sound to inform the 
call reception is generated (step S508) and the 
present program is finished. 

If step S507 was executed after the image 
5 information had been displayed in step S506, both 
of the image information and the calling party num- 
ber are displayed by the display unit 4. 

As mentioned above, not only the calling party 
number is displayed in the image display unit 4 
to upon call reception but also the image information 
which is peculiar to the calling party, for instance, 
the image of the face or the like of the person on 
the calling party side is displayed in the image 
display unit 4. Thus, the calling partner .can be 
15 easily presumed before response and the user can 
prepare for a response. 

in the above embodiment, the calling party 
number area 201 upon call reception and the call- 
ing party number area 202 in line connection have 
20 separately been provided in the memory 2. How- 
ever, the invention is not necessarily limited to 
such a construction. The functions of both of those 
areas can be also performed by a single area. 
On the other hand, it is not always necessary 
25 to provide an image fetch key 3 but, for instance, it 
is also possible to execute the program of Fig. 4 
when a * key and a 0 key in the operation key 4 
were simultaneously depressed. Or, it is also possi- 
ble to provide a touch sensor for the image display 
30 unit 4 and to execute the program of Fig. 4 by 
touching the image display unit 4. 

Further, it is also possible to construct in a 
manner such that a touch panel is attached to the 
image display unit 4 and by touching a predeter- 
35 mined position of an image which is displayed in 
the image display unit 4, an inputting operation to 
the control unit 1 is executed, and the image fetch 
key 3 also has the function of the operation key 4. 
Further, the process in step S409 in Fig. 4 in 
ao the embodiment can be also executed in the fol- 
lowing manner. That is, the frequency of the read- 
ing and displaying operations due to the call recep- 
tion of the image information of the corresponding 
image area is counted every area in the telephone 
45 number area 203 in the memory 2 and the area 
having the minimum frequency is used to store and 
update the calling party number and the image 
information corresponding to a command output 
from the image fetch key 11. That is, when the 
.so storage area of the image lacks, the storage image 
of a small frequency which is read out in response 
to the call reception is erased together with the 
corresponding telephone number, thereby updating 
to the new telephone number and image informa- 
55 tion. Fig. 6 shows a flowchart in this case. 

In the above embodiment, the image which is 
sent from the calling party has been used as image 
information. However, the image photographed by 
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the camera unit 6 on this side can be also input as 
image information to the image area 204. In this 
case, since the camera unit 6 for transmitting the 
image is also commonly used, there is no need to 
additionally provide another inputting means. For 
instance, a memorandum on which information 
such as process of a business talk with the calling 
party, thanks to a present from the calling party, 
name and family construction of the calling party, 
and the like was written is put up in front of the 
camera unit 6 as shown in Fig. 7 and the image 
fetch key 11 is depressed, thereby storing the 
image on the memorandum into the image area 
204, and the calling party telephone number is 
stored into the corresponding area in the telephone 
number area 203 by the operation key 3. 

That is, when the television telephone executes 
none of the transmission and reception, by putting 
up the memorandum sheet to a position in front of 
the camera unit 6 and depressing the image fetch 
key 1 1 , a program of a flowchart shown in Fig. 8 is 
executed. It is first instructed to input the calling 
party telephone number by the operation key 3. 
When the calling party telephone number is input, 
the image on the memorandum sheet is read as 
image information by the camera unit 6. After that, 
the calling party telephone number and the image 
information are stored into the memory 2 in accor- 
dance with the same procedure as that of the 
processes in step S402 and subsequent steps in 
Fig. 4. On the other hand, the display upon call 
reception is executed in accordance with the same 
procedure as that shown in Fig. 5. 

As described in detail above, according to the 
first embodiment, in the television telephone set 
connected to the ISDN having the calling party 
number display service, the communicating ap- 
paratus comprises: the first memory for storing a 
calling party number from the ISDN upon call re- 
ception and for storing the calling party number 
(i.e., destination side number) in line connection; 
the second memory having a plurality of sets of 
telephone number areas and image areas respec- 
tively corresponding to the telephone number 
areas; the image fetching means for outputting a 
command to store image information which is dis- 
played on the image display apparatus of the tele- 
vision telephone set into the second memory; and 
the control means for controlling in a manner such 
that the calling party number (destination side num- 
ber) stored in the first memory and the image 
information displayed on the image display appara- 
tus are respectively stored into either one of the 
plurality of sets of telephone number areas and 
image areas in the second memory in accordance 
with a command output from the image fetching 
means in the line connection and the calling party 
number stored in the first memory and the calling 



party numbers (destination side numbers) stored in 
the telephone number areas in the second memory 
are sequentially compared upon call reception from 
the ISDN and when they coincide, the image in- 

5 formation stored in the image area in the second 
memory corresponding to the telephone number 
area in which the coincident calling party number 
(destination side number) has been stored is dis- 
played on the image display apparatus. Therefore, 

io in spite of a simple apparatus, the image informa- 
tion enough to presume the calling party can be 
previously stored on the reception side together 
with the corresponding telephone number by the 
simple operation. Therefore, just before the recep- 

75 tion side responds to the call reception, the image 
information regarding the calling party, for instance, 
the face of the calling party or the like is displayed 
on the image display apparatus on the reception 
side and the calling party can be easily presumed. 

20 

(Second embodiment) 

As a second embodiment, explanation w? ; 
be made with respect to the case where the 

25 corresponding to the calling party number^ \\ 
destination side number) upon call reception is 
displayed and the user can immediately disconnect 
the communication if he doesn't talk to the calling 
party and the case where a moving image is used 

30 as an image. 

The second embodiment of the invention win 
now be described herein be low with referenc 
the drawings. Fig. 9 is a block arrangement 
gram of a multimedia communicating apparatus 

35 which can communicate a voice, data, and a mov- 
ing image according to an embodiment of the 
invention. In the diagram, reference numeral 1001 
denotes a multimedia communicating apparatus us- 
ing a line based on the ISDN (integrated services 

40 digital network). The multimedia communicating 
apparatus 1001 has a main control unit 1002. The 
main control unit 1002 comprises: an operation unit 
1003; a CPU 1004; a ROM 1005; and a RAM 
(registering means) 1006. The operation unit 1003 

45 executes various operations of the whole multi- 
media communicating apparatus 1001 and has a 
keyboard (not shown) and a touch sensor on a 
display unit 1013, which will be explained herein- 
later. The CPU 1004 controls the whole apparatus 

so 1001. A program to control the multimedia commu- 
nicating apparatus 1001 which is executed by the 
CPU 1004 has been stored in the ROM 1005. 
Various data, images, calling party numbers, and 
the like have been stored in the RAM 1006. 

55 An audio interface unit 1007 and a video inter- 
face unit 1007 are respectively connected to the 
main control unit 1002. A handset (transceiver) 
1009 for inputting or outputting a voice, a micro- 
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phone 1010 for inputting a voice, and a speaker 
1011 for_generating the voice are connected to the 
audio interface unit 1007. respectively. The audio 
interface unit 1007 executes the interface with the 
handset 1009, microphone 1010. and speaker 
1011. A camera 1012 for inputting a moving image 
and the display unit (display means) 1013 for out- 
putting the moving image or a message are con- 
nected to the video interface unit 1008. The video 
interface unit 1008 executes the interface with the 
camera 1012 and display unit 1013. The audio 
interface unit 1007 is connected to an audio 
encode/decode unit 1014 for compressing or ex- 
panding an audio signal. On the other hand, the 
video interface unit 1008 is connected to an image 
encode/decode unit 1015 for compressing or ex- 
panding an image signal. The encoding/decoding 
process of a moving image has been disclosed in 
detail in the CCITT recommendation idea H.261. 
The audio encode/decode unit 1014 and the image 
encode/decode unit 1015 are connected to a 
multiplication/separation unit 1016 for multiplexing 
and separating the data, voice, and image signal. 
The multiplication/separation unit 1016 has been 
disclosed in detail in the CCITT recommendation 
idea H.221. A data interface unit 1017 for perform- 
ing the interface with the CPU 1004 is connected 
between the multiplication/separation unit 1016 and 
the main control unit 1002. The 
multiplication/separation unit 1016 is connected to 
a line interface unit 1018 for executing the interface 
with the line (ISDN). 

As shown in Fig. 10, the display unit 1013 has 
a body 1019. An image display unit 1020 for dis- 
playing a moving image, a message display unit 

1021 for displaying a message, a first touch sensor 

1022 for instructing the acceptance of the recep- 
tion, and a second touch sensor (disconnecting) 
means 1023 for instructing the end of the reception 
are arranged on the front surface of the body 1019, 
respectively. 

A control procedure of the multimedia commu- 
nicating apparatus 1001 will now be described with 
reference to Fig. 1 1 . Fig. 1 1 is a flowchart showing 
a control procedure upon reception processing. 
First, when a calling signal is received, a check is 
made in step S1 to see if the received calling party 
number exists or not (in the ISDN used as a line of 
the multimedia communicating apparatus 1001 of 
the invention, if the user contracted with the calling 
party number notification service, when a set-up 
signal is received from the network, the calling 
party number is included). 

If the calling party number exists, the answer in 
step S1 is YES and the processing routine ad- 
vances to step S2. In step S2, a check is made to 
see if the received calling party number coincides 
with the registered calling party number which has 



been registered in the RAM 1006 or not. If YES. 
step S3 follows and an image of the face which has 
been registered in the RAM 1006 and corresponds 
to the received calling party number is displayed in 

5 the image display unit 1020 of the display unit 
1013. The image in the RAM 1006 is the image 
which was sent from the calling party during the 
preceding communication and has been stored as 
a pair together with the calling party number. The 

to user who received the call can immediately recog- 
nize who is the calling party by seeing the image 
displayed in the image display unit 1020. After the 
image was displayed in the image display unit 
1020 in step S3 as mentioned above, in the next 

is step S4, the received calling party number is dis- 
played in the message display unit 1021 in the 
display unit 1013. In the next step S5. a reception 
sound is generated from the speaker 1011. Then, 
step S6 follows. If NO in step S1. that is, if the 

20 corresponding calling party number does not exist, 
step S5 is executed. Further, if NO in step S2, 
namely, if the received calling party number differs 
from the registered calling party number which has 
been registered in the RAM 1006, step S4 is ex- 

25 ecuted. In step S6, a check is made to see jf the 
second touch sensor 1023 for instructing the end of 
the reception has been depressed or not. That is, if 
the image displayed in the image display unit 1020 
relates to the partner whom the user on the recep- 

30 tion side doesn't want to make a speech, the 
second touch sensor 1023 is depressed. Therefore, 
if the end of the reception has been instructed by 
depressing the second touch sensor 1023, the an- 
swer in step S6 is YES, so that step S14 is 

35 executed and the line is immediately disconnected 
and the processing routine is finished. That is, the 
line can be disconnected before responding to the 
call reception. On the other hand, if the image 
displayed in the image display unit 1020 relates to 

40 the partner whom the user desires to make a 
speech, the second touch sensor 1023 is not de- 
pressed. Therefore, the answer in step S6 is NO 
and the processing routine advances to step S7. In 
step S7, a check is made to see if the first touch 

45 sensor 1022 for instructing the acceptance of the 
reception has been depressed or not. If NO in step 
S7, step S5 is executed. On the contrary, if YES in 
step S7, that is, if the acceptance of the reception 
has been instructed by depressing the first touch 

50 sensor 1022, step S8 follows and the audio 
encode/decode unit 1014 is activated and the 
transmitted voice is received. Then, step S9 follows 
and the image encode/decode unit 1015 is ac- 
tivated and the moving image is received. In the 

55 next step S10, a check is made to see if the 
received calling party number exists or not. If YES, 
in the next step 311. the first sheet of the received 
moving image (or an arbitrary one sheet) is regis- 
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tered into the RAM 1006. Then, in step S12. the 
received- calling party number is registered into the 
RAM 1006 in correspondence to the image which 
was registered in step Sit. After that, step S13 
follows. After completion of the registration of the 
image and the calling party number in steps S12 
and S13, the image of the same calling party 
number is erased. In step S13, a check is made to 
see if the second touch sensor 1023 for instructing 
the end of the reception has been depressed or 
not If the end of the reception has been instructed 
by depressing the second touch sensor 1023, step 
S14 is executed and the line is disconnected. If NO 
in step S13, step S13 is executed until the end of 
the reception is instructed. If NO in step S10, 
namely, if the corresponding calling party number 
does not exist, step S13 is executed. 

In the embodiment, the calling party number 
has been input from a time point of the received 
set-up signal. However, the invention is not limited 
to the above method. It is also possible to use a 
method whereby the data including the calling par- 
ty number is multiplexed and transmitted together 
with the voice and image on the calling party side 
and the calling party number in the transmitted 
data is separated and input on the reception side. 

On the other hand, in the above embodiment, 
one latest received image has been registered into 
the RAM 1006 for one calling party number. How- 
ever, the invention is not limited to the above 
method but any one of the following methods © to 
@ can be also used. 

© The oldest received image is registered for 
one calling party number and the image registering 
process is not executed for the same calling party 
number. 

(2) A plurality of sheets of received images are 
registered in a lump for one calling party number 
and a plurality of sheets of registered images are 
displayed in the image display unit 1020 upon call 
reception. Fig. 12 is a flowchart showing a control 
procedure upon receiving process in such an em- 
bodiment. The process in step S3a in Fig. 12 
corresponds to a modification of step S3 in Fig. 11. 
Steps Sl1a, S11b, S11c, S11d, and Sl1e in Fig. 
12 correspond to a modification of step S11 in Fig. 
11. Further, the other steps in Fig. 12 are similar to 
those in Fig. 11. That is, in step S3a, a plurality of 
sheets of images which were registered in cor- 
respondence to the calling party numbers are dis- 
played in a lump. If YES in step S10, a counter i is 
cleared to 0 in step S11a. In the next step Sub, a 
check is made to see if the count value of the 
counter i is equal to N (the maximum value of the 
number of registered image sheets for one calling 
party number) or not If YES, step S12 follows. If 
NO, step S11C follows. In step S11c, the count 
value of the counter i is increased one. In step 



Slid, the ith sheet of image is registered. In step 
SHe, the apparatus waits for T seconds (preset 
registration interval between images) and the pro- 
cessing routine is returned to step Sl1b. Since the 

5 other steps in Fig. 12 are similar to those in Fig. 
1 1 , the same reference numerals are written on the 
drawings and their descriptions are omitted. 

® Continuous received images are registered 
for a predetermined time for one calling party num- 

10 ber and the continuous registered images are re- 
petitively displayed as a moving image by the 
image display unit 1020 upon call reception. Fig. 
13 is a flowchart showing a control procedure upon 
receiving process in such an embodiment. Step 

75 S3b in Fig. 13 corresponds to a modification of 
step S3 in Fig. 11. Steps S21, S22, S23, S24, and 
S25 in Fig. 13 correspond to a modification of step 
Si 1 in Fig. 13. Further, the other steps in Fig. 13 
are similar to those in Fig. 11. That is, if YES in 

20 step S2, the display of the registered images is 
started in step S3b and the processing routine 
advances to step S4. The single display time of the 
registered images is set to N seconds and a plural- 
ity of registered images are repetitively continu- 

25 ously displayed for this time. Due to this, the 
images upon call reception can be displayed as a 
moving image in a manner similar to the ordinary 
received images. On the other hand, if YES in step 
S10, a timer is started in step S21. The image 

30 registration is started in step S22. In step S23, a 
check is made to see if N seconds have elapsed 
from the start of the image registration or not. If 
NO, step S22 is repeated until N seconds have 
elapsed. If N seconds have elapsed, the timer is 

35 stopped in step S24. The image registration is 
stopped in step S25, then step S12 follows. That is, 
the images are registered at a predetermined inter- 
val of time until N seconds elapse. Since the other 
steps in Fig. 13 are similar to those in Fig. 11, the 

40 same reference numerals are written on the draw- 
ings and their descriptions are omitted. 

0 Each time of the reception, the received 
image is additionally registered for one calling par- 
ty number and a plurality of sheets of registered 

45 images are displayed in the image display unit 
1020 upon call reception. Fig. 14 is a flowchart 
showing a control procedure upon receiving pro- 
cess in such an embodiment. Step S3c in Fig. 14 
corresponds to a modification of step S3 in Fig. 1 1 . 

so Steps S31, S32, and S33 in Fig. 14 correspond to 
a modification of step S11 in Fig. 11. Further, the 
other steps in Fig. 14 are similar to those in Fig. 
11. That is, in step S3c, a plurality of sheets of 
images which were registered for the calling party 
55 number are displayed in a lump. On the other 
hand, if YES in step S10, a check is made in step 
S31 to see if the number of images registered for 
the calling party number has reached N (preset 
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maximum number of sheets) or not. If YES, step 
S32 follows. If NO, step S33 follows. In step S32, 
the oldest registered image is deleted (at this time, 
the number of registered images is equal to N - 1). 
In step S33, the image which is received at present 
is additionally registered and step S12 follows. 
Since the other steps in Fig. 14 are similar to those 
in Fig. 11. the same reference numerals are written 
on the drawings and their descriptions are omitted. 

Further, in the embodiment, although the re- 
ceived images have been registered into the RAM 
1006. the invention is not limited to such a method. 
The received images can be also registered to a 
magnetic disk or a magnetic tape. 

As mentioned above, the multimedia commu- 
nicating apparatus of the second embodiment of 
the invention comprises: the registering means for 
registering the received image together with the 
calling party number upon image reception; display 
means for displaying the image registered by the 
registering means corresponding to the calling par- 
ty number when the same calling party number as 
the calling party number registered by the register- 
ing means was received; and disconnecting means 
for disconnecting the communication without start- 
ing a speech in the case where the image dis- 
played by the display means relates to a partner to 
whom the user doesn't want to make a speech. 

Therefore, upon reception, by seeing the im- 
age of the face of the partner displayed by the 
display means, it is possible to immediately recog- 
nize who is the partner without starting the speech. 
Therefore, the communication can be soon discon- 
nected for the partner to whom the user doesn't 
want to make a speech. 

On the other hand, according to the embodi- 
ment, upon reception, a plurality of registered im- 
ages can be simultaneously displayed or can be 
displayed as a moving image. Further, a recogni- 
tion degree of the communication party upon call 
reception can be raised. Although there is also a 
case where a plurality of persons use the ap- 
paratuses of the same calling party number, ac- 
cording to the embodiment shown in Fig. 14, the 
received images are registered every plurality of 
reception times and a plurality of registered images 
are displayed upon call reception. Consequently, a 
plurality of persons who use the apparatuses of the 
same calling party number can be recognized in a 
lump upon call reception. 

Although the invention has been described 
above with respect to the preferred embodiments, 
the invention is not limited to the foregoing em- 
bodiments. Many modifications and variations are 
possible within the spirit and scope of the appen- 
ded claims of the invention. 

Claims 



1. A communicating apparatus comprising: 

receiving means for receiving image data sent 
from a calling party communicating apparatus; 

5 memory means for storing the image data re- 

ceived by the receiving means in correspon- 
dence to ID data indicative of the calling party 
communicating apparatus; and 
display means for receiving the ID data upon 

to reception from the calling party communicating 

apparatus and for reading out the image data 
corresponding to the received ID data from the 
memory means and for displaying. 

/5 2. An apparatus according to claim 1, further hav- 
ing means for selecting the storing operation of 
the image data into the memory means, and 
wherein when the storing operation is selected 
by the selecting means, the memory means 

20 stores the image data which is being received. 

3. An apparatus according to claim 2, wherein the 
memory means stores a plurality of image data 
from a plurality of communicating apparatuses 

25 in correspondence to a plurality of ID data. 

4. An apparatus according to claim 3, wherein 
when the storing operation is selected by the 
selecting means, if storage areas in the mem- 

30 ory means are filled with data, the ID data and 
the image data in a predetermined storage 
area are erased and the ID data of the calling 
party communicating apparatus during com- 
munication and the image data from the calling 

35 party communicating apparatus are newly 

stored into said predetermined storage area. 

5. An apparatus according to claim 4. wherein the 
predetermined area from which the ID data 

40 and the image data are erased is an area in 

which the image data from the communicating 
apparatus having a small reception frequency 
has been stored. 

45 6. An apparatus according to claim 1, wherein if 
the image data corresponding to the ID data 
indicative of the calling party communicating 
apparatus has already been stored in the 
memory means, the stored image data is up- 

50 dated to the newly received image data. 

7. An apparatus according to claim 1 , further hav- 
ing disconnecting means for disconnecting the 
communication before reception of the image 

55 data from the calling party communicating ap- 

paratus. 

8. A communicating apparatus comprising: 
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registering means for registering a received 
image together with a calling party number 
upon reception of the image; 
display means for displaying the image regis- 
tered by the registering means and corre- 5 
sponding to the calling party number when the 
same calling party number as the calling party 
number registered by the registering means 
was received; 

disconnecting means for disconnecting a com- 10 
munication without starting a speech in the 
case where the image displayed by the display 
means relates to a calling party to whom the 
speech is not desired. 

75 

9. A communicating apparatus comprising: 

receiving means for receiving a plurality of 
sheets of images sent from a calling party 
communicating apparatus; 

memory means for storing the plurality of 20 
sheets of images received by the receiving 
means in correspondence to ID data indicative 
of the calling party communicating apparatus; 
and 

display means for displaying the plurality of 25 
sheets of images stored in the memory means 
upon call reception from the calling party com- 
municating apparatus. 



10. An apparatus according to claim 9, wherein the 
display means simultaneously displays a plu- 
rality of sheets of images. 

11. An apparatus according to claim 9, wherein the 
display means sequentially displays a plurality 
of sheets of images and displays and outputs 
as a moving image. 

12. A communicating apparatus comprising: 
audio data input/output means; 

image data input/output means; 
communicating means for transmitting and re- 
ceiving the audio data and the image data; 
memory means for receiving an image from 
the image data input means and for storing in 
correspondence to ID data indicative of a call- 
ing party communicating apparatus; and 
display means for displaying the image stored 
in the memory means upon call reception from 
the calling party communicating apparatus. 

13. A television telephone connected to an ISDN 
having a calling party number display service, 
comprising: 

a first memory for storing a calling party num- 
ber from the ISDN upon call reception; 
a second memory having telephone number 
areas and image areas corresponding to the 



telephone number areas; 
image fetching means for outputting a com- 
mand to store image information which is dis- 
played by an image display apparatus of the 
television telephone into the second memory; 
means for respectively storing the calling party 
number stored in the first memory and the 
image information displayed by the image dis- 
play apparatus into the telephone number area 
and the image area in the second memory in 
accordance with a command output from the 
image fetching means during connection of a 
line; 

means for comparing the calling party number 
stored in the first memory and the calling party 
numbers stored in the telephone number areas 
in the second memory upon call reception 
from the ISDN; and 

control means for controlling in a manner such 
that when those calling party numbers coin- 
cide, the image information stored in the image 
area in the second memory corresponding to 
the telephone number area in which the co- 
incident calling party number has been stored 
is displayed by the image display apparatus. 

14. A telephone according to claim 13, wherein the 
first memory stores the calling party number 
from the ISDN in the case of a calling from the 

30 calling party side during connection of the line 

and stores the calling party number which was 
called in the case of a calling from this side. 

15. A telephone according to claim 13, wherein the 
35 first memory comprising a calling party num- 
ber area in call reception and a calling party 
number area in line connection. 

16. A telephone according to claim 13, wherein the 
40 image fetching means generates an output sig- 
nal by touching the image display apparatus. 

17. A telephone according to claim 13, wherein the 
control means controls in a manner such that a 

45 frequency when reading out and displaying the 

image information stored in the corresponding 
image area is counted every telephone number 
area in the second memory and the telephone 
number area having the smallest frequency is 

59 used to store and update the calling party 

number and the image information correspond- 
ing to a command output from the image 
fetching means. 

55 18. A videophone which can display an image in 
response to identity data relating to the origi- 
nator of an incoming call, the image being 
derived from image data which has been pre- 
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stored in association with the identity data, the 
videophone comprising pre-storing means for 
pre-storing such image data, 
characterised in that the pre-storing means is 
operable to store as said image data at least s 
one of (a) image data received from the other 
party during a videophone call, and (b) image 
data provided by an image sensing means of 
the videophone which image sensing means is 
used during a videophone call to generate w 
image data to be provided to the other party. 
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0 There is disclosed a communicating apparatus 
such as a television telephone connected to the 
ISDN having a calling party number display service, 
comprising: a receiving unit for receiving image data 
sent from a calling party communicating apparatus: 
a memory for storing the image data received by the 
receiving unit in correspondence to 10 data indica- 
tive of the calling party communicating apparatus; 
and a display apparatus for receiving the ID data 



WAGE FETCH KEY 



3-- 



OPERATION KEY 



^" ^DISPLAY UNIT j »— 
5 " w | HANDSET 



CAMERA UNIT 



upon call reception from the calling party commu- 
nicating apparatus and for reading out the image 
data corresponding to the received ID data from the 
memory and for displaying. Before a speech is start- 
ed, the user can see the image information regard- 
ing the calling party and can immediately disconnect 
the communication if he doesn't want to make a 
speech to the calling party upon call reception there- 
from. 
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